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1. Introduction 

The brownian bridge is a universally known model which is widely used in 
several areas of applied mathematical science. As only an example, the recent 
publication of [8, 10] and the reference therein provide a huge interested litera- 
ture, while [2] provide a theoretical analysis of such a process. The main aspect 
of the browinan bridge is its periodicity, that makes this model widely used. On 
the other hand, a lack of this model is its non-stationarity, which is almost a 
must when one models pure noise. Motivated by these two facts, we focus here 
on Jff, the set of gaussian, stationary, periodic processes, which can be thought 
as the space of the 'noises' on a periodic data, e.g. the noise on a contour of a 
closed feature on an image, or, more generally, the noise on a stationary, peri- 
odic, functional data process. In this paper, the set is studied in order to 
provide a simple and general method for constructing models of arbitrary reg- 
ularity, which can be used in modeling real data. A "good" noise model is then 
generated by a process in conditioned to be when t — 0. Surprisingly, the 
brownian bridge can not be generated in this way. Indeed, it is generated by a 
gaussian, stationary, antiperiodic processes conditioned to be when t ~ (and 
hence periodic!). 

The paper is organized as follows. In the next Section 2, we recall that 
is isometrically equivalent to £^ as a consequence of Karhunen-Loeve's theorem. 
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Notably, the isomctry is build via Fourier transform. In partieular, FFT is used 
in application, which makes the set computationally feasible. 

In Section 3, we show that the brownian bridge can not be obtained by 
conditioning a process in ^ . In Section 4 we show that any process in Jif 
shares asymptotically the spectrum with itself when it is "conditioned to be 
at t = 0" . In Section 5 it is proven that also the path regularity is maintained 
for such couples. 

The Section 6 presents a simple parametric model in for constructing 
noise models on the circle with path processes of arbitrary regularity. Finally, 
maximum likelihood asymptotic properties are studied for the parameters of 
this model. 

For what concerns notations, s, t, . . . relates to time variables, and will often 
belong to [0, 1]. We denote by {xt}t£[o,i\i {vt}t^[Q,i], ■ ■ ■ stochastic adapted pro- 
cess defined on a given filtered space (fi, J", {J"t}fg[o,i],P), while {Yn)n, 
{Zn)n, ■ ■ ■ are sequences of random variables. C{s,t) is a positive semidefinite 
function (it will be the correlation function of a stochastic process). When a 
process is stationary, its covariance function will often be replaced by the asso- 
ciated covariogram function C{t~s) = C{s,t). The sequence (efc(t))fcgN denotes 
a sequence of orthogonal function on L^([0,1]). Finally, we denote by the 
fractional part sawtooth function of the real number t, which is defined by the 
formula = t — floor (t). 

2. Preliminaries and Karhunen-Loeve's decomposition theorem 

In this section we recall some basic results from gaussian processes theory. The 
first theorem we need is the Karhunen-Loeve's decomposition theorem (see [7]), 
that states what follows. 

Theorem 2.1 (Karhunen-Loeve). Let {xt}te[o,i], such that E[xt] = 0, and 
Cov{xt,Xs) = C(t,s), continuous in both variables. Then Xt = X^fcLi ■^fc 
where 

• the functions {ek{-))k are the eigenf unctions of the following integral op- 
erator from L^[0,1] in itself 



and (efc-))fc form an orthonormal basis for the space spanned by the eigen- 
functions corresponding to nonzero eigenvalues; 
• the random variables Zi, Z2, . ■ ■ are given by = /q Xtek{t)dt and form a 
zero-mean orthogonal system (i.e., E{ZkZj) = for k ^ j) with variance 
A|, where Xf, is the eigenvalue corresponding to the eigenfunction efc(-). 

The series X^fcLi Z^ekit) converges in mean square to Xt, uniformly in t: 
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Finally, xt is a gaussian process if and only if{Zk)k is a sequence oj independent 
gaussian random variables. 

2. 1 . Representation of the set with respect to the Fourier basis 

(Sfc(t), Ck{t))k 

We deal in this paper with the following set Jif of processes, thought as the set 
of 'pure gaussian noises' on the unit circle. 

Definition 2.1. Let {xtjtgjo^i] be a stochastic process with covariance func- 
tion C{s,t) = Cov{xt,Xs)- is the set of real gaussian stochastic processes 
{xt}telo,i] such that 

zero-mean: E{xt) = 0, Vi G M; 

continuously stationary: there exists a continuous real function C such that 

C{s,t) = C{s-t), Vs,t e R; 
periodic: {xt}te[o,i] admits a periodical version (i.e. xq = xi,a.s.). 

Remark 1. A necessary and sufficient condition for a continuously stationary 
process to be periodic is that (7(1) = C{0). This allows a continuous version of 
the process with Var{xt-i-i — xt) = for any t e M. 

Remark 2. We remark that if {xt}t<£[o.i] G ^ ^i^d if C{s — <) = C{s,t) is its 
covariogram function, then C{t) = C{t +1). 

The set Jif is a Hilbert space, when it is equipped with the inner product 
given by 

i{xt}te[o.i],{yt}te[o.i]) = / E{xtyt)dt e K+. 

Jo 

Karhunen-Locvc's decomposition theorem can be specialized to J^, in order to 
show that a process is in if and only if it can be written as limit of a canon- 
ical trigonometric random series, namely the sequence 1, (sfe(t), Cfe(t))fe, where 
Sk{t) = y/2 sm{2kTTt) and Ck{t) = cos(2fc7ri). 

Theorem 2.2. Let {xt}te[Q.i] € ^ with covariance C{s,t) = C(t — s); then in 
mean square, uniformly in t, 

oo 
k=l 

where {Yn)n, {Yn)n ciT^s two independent sequence of independent standard gaus- 
sian variables, and {ck)k S is such that 

~ C{s) cos{2mTs)ds, n = 0,1,2,... 

"'0 

Proof. Sec Appendix A. □ 
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Theorem 2.3. Let (1^)„, {Y^)n be two independent sequence of independent 
standard gaussian variables, and (ck)k € Then the sequence 



Vi 



(") 



cor„' + ^cfc(yfeSfc(t) + y,!cfe(t)) 



fe=i 



converges in mean square, uniformly in t to {yt\te[o.i] ^ ■ Moreover ifC{s,t) 
is the Uf covariance function, then uniformly, absolutely and in £^[0, 1] x [0, 1], 



C{S, t)=cl+Y, clckis)Ckit) + 4sfe(s)Sfe(i) 
k=l k=l 

oo oo 

= Co + 2 ^ Cfc cos(2fc7rs) cos(2fc7ri) + 2 ^ sin(2fc7rs) sin(2fc7ri) (2.2) 

k=l k=l 

oo 

2^4cos(2fc7r(s - <)). 



fe=i 



Proof. Sec Appendix A. □ 

Remark 3. As a consequence of the Theorem 2.2 and Theorem 2.3, we can 
observe that periodic processes with period have only mk terms in their 
expansion: 

oo 

Xt+J. = CoFq + CmkiYmkSrnkit + ) + Y,'„,,C„-,k{t + = Xt 

k=l 

More fancy, processes having only odd terms are antiperiodic with period ^, i.e. 

oo 

Xt+l = X!'^2fe+l(>"2fc+lS2fc+l(t + |) + l"4+lC2/c+l(i + |)) = -Xt. 
k=0 

An immediate consequence of this remark is that when one needs to model a 
pure noise on the circle, then he must choose processes whose expansion have 
both odd and even terms. 



2.2. The quotient set J^z 

It is easy to see that can be seen as a Hilbert space, isometrically equivalent 
to the space of the coefficients let us consider a couple Z = ((F„)„, {Y'n)n) 
of independent sequence of independent standard gaussian variables. For each 
{zt}tg[o.i] S there exists an {xt}t^[o.i] S -^z having the same law, where 

oo 

•^z = {{xt} eJ^:xt= aoY'o + ^ ak{YkSk{t) + Y'kCk{t)), (a„)n e 

fc=i 
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and the limit is in mean square and uniformly in t. From Theorem 2.2 and 
Theorem 2.3 it is naturally defined an isometry between the representative space 
Jfz and 

OO 

xt = floF'o + ak{YkSk{t) + y'feCfe(t)) ^ (ao, \/2ai, V2a2, V2a3, . . .)„ G 
fc=i 



where \\xt\\jf^^ = + 2E„ 4- 

.2.5. T/ie space and its relation with Jfz 

By Theorem 2.3 given {ci)i S there exists a unique {xt,t e [0, 1]} G , 
with covariance function given by 

oo 

C{s,t) ^ cl + Y,4ck{s)ck{t). 

k=l 

The process {xt}, conditioned to be at t = 0, is the periodic zero- mean gaussian 
process {yt} with covariance function 

C(g,0)C(0,^) 

c(o,o) ■ ('-^^ 

Let us define the set J^q of such processes. 
Definition 2.2. Let be the following set 

^ = {{yt}te[o,i] ■ 3{xt}te[o,i] ^ ^ such that 

^{{yt, ,...,ytj) = ^{{xt, ,...,XtJ\xo^ 0), V< e [0, 1]", n £ N}. 

We call: 

Generator process: the process {xt}t<£[o,i] G 
Generated process: the process {yt}t<£[o,i] ^ 

It is easy to show that {yt}te[o.i] ^ =^ because it is not stationary. However, 
the function i?(s, t) is symmetric, and hence it is the L2-lhnit of its 2-D Fourier 
series. With the notation given above, with Co(t) = 1, we get the series expansion: 

oo oo 

''■'=° (2.4) 

OO OO ^ ' 

k=l,j=0 fc=Oj = l 

The following theorem gives a necessary and sufficient condition for a pro- 
cess {yt,t e [0,1]} with covariance function R{s,t) to have a unique process 
{xt} G J^z which generates it. The trivial case when R{s,t) = (generated by 
a constant process) is omitted since it is the sole case when the solution is not 
unique. The proof may be found in Appendix A. 
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Theorem 2.4. For any gaussian process {yt,t G [0,1]} such that j/o = 0, 
E{yt) = and continuous covariance function R{s,t) ^ 0, there exists a unique 
(in law) stationary process {xt} € J^z which generates {yt} if and only if the 
Fourier coefficients of R{s,t) satisfy: 

• the mixed matrices cos — sin and sin — cos are null: 

• the sin — sin matrix is a non-negative diagonal in £^ : 



Ml 







r|| 
r|| 



with r^l > and Tqq < r 



Ek 



< oo; 



defined Tqq = -f^"lc , the cos — cos matrix is built from the sin — sin matrix 



and rgg; 



(rTk) 



jk)j.k>0 






v.... 



'11 







y,SS 

'22 



' 00 



'oo'oo 

/ytS S tytS S 

'11 '00 

/ytS S tytSS 

'22' 00 



'oo' 11 

'^11' 11 
''22 ''ii 



rss „ss 
00' 22 

lytSS ^SS 

' 11'22 
'22' 22 



3. On the brownian bridge 

In the previous sections we built the set as the set of the gaussian stationary 
and periodical processes. A process in this set should be used when one models 
a pure gaussian noise on the circle. When one needs the process to be zero at 
the starting point, he should restrict the choice to J^/fo. 

One of the models mainly used for periodic noise is the brownian bridge, i.e. 
the process {yt}t<£[o.i] such that yt = Wf — tWi, where Wt is a brownian motion. 
This process is gaussian, periodic and not stationary, since yo = ?/i = 0. In order 
to be a good model for pure noise the brownian bridge should belong to Jffo, 
i.e., it should be the conditioned process of a stationary process {xt} S J^- The 
next theorem shows that this is not the case. 

Theorem 3.1. Let {yt}tg[o,i] be a brownian bridge. There does not exists a 

process {xt} € Jff which generates {yt}tGlo,i]' {yt}te[o,i] ^ 

Proof. See Appendix B. □ 

The Theorem 3.1 states that no process in Jff generates a brownian bridge. 
The following question is if the paths of a brownian bridge may be extended on 
[0, 2] in such a way that the extended process is in J^o{0, 2). The answer is quite 
surprising, if we do not underling the following result. 
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Theorem 3.2. Let {zt}te[o.i] be a non deterministic, gaussian process with 
Zo = 2i = and continuous covariance function R(s,t), s,t € [0, 1]. There is at 
most one extension of {zt}tiz[o^i] to {zt,t G [0,2]} € J^(0,2). Moreover, Zt is 
either 1-antiperiodic or l-periodic (see Remark 3). 

Proof. Sec Appendix B. □ 

The brownian bridge is generated by an 1-antiperiodic stationary process. 

Theorem 3.3. There exists a unique extension {yt,t € [0,2]} e J^(0, 2) of the 
brownian bridge {yt}te[o,i] - Moreover, {yt,t € [0,2]} is generated by 



Xt 



2 

= E ^^2k + l) ''""^^^^^ + ^^^^ + cos(^(2/c + (3.1) 



which is l-antiperiodic. 

Proof. See Appendix B. □ 



4. A process in shares the same asymptotic behavior for the 
spectrum with its generator 

We want to get information about Fourier coefficients of Karhunen-Loeve ex- 
pansion for processes in .Jifo witlr respect to the coefficients of their generators 
in J^. To do tliis, as described in the Theorem 2.1, it is sufficient to study 
the spectrum of tlie integral operator induced by tlie covariance function of the 
process {yt}telo,i] & ^ generated by {a;t}te[o,i] G J^- 

Theorem 4.1. Denote by {yt}te[o,i] process in and by {xt}t£[o.i] its gener- 
ator in J^. Let {c„},igN € be the sequence of Fourier coefficients of Karhunen- 
Loeve expansion of the process {xt}te[Q.i] (as in Theorem 2.2 and Theorem 2.3), 
and let {c„}„gN be the sequence of Fourier coefficients of Karhunen-Loeve expan- 
sion of the process {yt}tg[o,i]- Then the sequences are asymptotic: (c„)„ x (c„)„. 

Proof. See Appendix C. □ 

5. A process in -J^q shares the same path regularity properties with 
its generator. 

We showed in Theorem 4.1 that a process in and its generator in share 
the same asymptotic behavior for the spectrum. In this section, we show that 
the regularity of the paths is also maintained. 
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5.1. Holder regularity of the paths of processes in ^ and in Jf^o 

We first remind that the Holder space C'^'"([0, 1]), where fc > is an integer and 
< a < 1, consists of tliose functions on [0, 1] having continuous derivatives up 
to order k and such that the fc'^-derivative is Holder continuous with exponent 
a. We recall a classic regularity theorem. 

Theorem 5.1 (see [12]). Let {xt}te[o,i] a, real stochastic process such that there 
exist three positive constants 7, c and e so that 

Eilxt-x,]-') <c\t-s\'+'; 

then there exists a modification {it}tg[o,i] of {xt}t£[o^i], such that 

for alia € [0, in particular the trajectories o/{x(}(g[o.i] belongs to C'''"([0, 1]). 

The following results are a immediate consequence of this last theorem (proofs 
may be found in Appendix D), where the processes {xt}teio,i] a-nd {yt}tg[o.i] 
are thought modified as in the Theorem 5.1. 

Theorem 5.2. Let {xt}te[o,i]j stochastic stationary process with null expec- 
tation, and let R{s,t) be its covariance function; if R & C'^'"([0, 1] x [0, 1]) then 
almost all trajectories of {xt}te[o.i] belong to C*''^([0, 1]) with (3 < ^ . 

It is simple to apply this last theorem to processes laying in and in J^q: 
assume that {a;t}tg[o.i] G ^ and let C{s,t) = C(s — t) be its covariance func- 
tion. If C e C'^'"([0,1]) , then almost all trajectories of {xt}teio,i] belongs to 
C°-^{[0, 1]), for any /3 < ^. The same argument can be applied to processes. 

In fact we can say something more. 

Theorem 5.3. Let {a;t}te[o,i] G =^ '"^'^ C^i^it) ~ C{s^t) be its covariance 
function. Consider its generated J^fo process {yt}tG[o,i] G '^'^c? R{s,t) be 
its covariance function. Then we have 

c c c«."(io, 11) ^ « c c»-(io, 1] X 10, u) ^ 1 5;:<i°; ;i; 

This last result implies that regularity properties of almost all trajectories of 
{it}tG[o,i] and of its generated process {yi}te[o,i] have the same lower bound, 
obtained by studying regularity of their covariance function. 
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5.2. Upper order regularity 

In Section 2.2, a sequence in is uniquely associated to each stochastic process 
in . We are now showing how the decrease rate of such sequence ia sasociated 
with the regularity of the process trajectory path. 

A very useful result for our analysis will be the following one, whose proof 
may be found in [9]. 

Theorem 5.4 (Boas' Theorem). Let / e L^[0,1] be a function whose Fourier 
expansion has only nonnegative cosine terms, and let (a„)„ be the sequence of 
its cosine coefficient. Then 

/GC°-([0,l])^a, = o(^). 

Boas' Theorem may be used in connection with Theorem 2.2 and Theorem 2.3 
to deduce more regularity properties of the processes in Jff, since C is a function 
whose Fourier expansion has only nonnegative cosine terms. In fact, take (c„)„ 
as in Theorem 2.2 and Theorem 2.3. From Boas' Theorem we have that if 
k^d = O(fciW) for < a < 1, then C G C2'"([0,l]) . This link between 
the regularity of C and the paths of {a;t}tG[o,i] underlined in the following 
theorem. The proof is in the Appendix D. 

Theorem 5.5. With the notations of Theorem 2.3, if c| — 0{-^^), then 
there exists a version of {xt\t<^[Q,i] whose trajectories belongs to C^'^ {\f),V\) , 
with /? < f . 

A natural generalization of this result is the following corollary. 

Corollary 5.1. With the notations of Theorem 2.3, if c^ = 0{ ) then 

there exists a version of {xt]i^^Q ^whose trajectories belongs to C""'^([0, 1]), with 
/3<f. 

6. A parametric model in ,3^ generalizing the brownian bridge 

Results provided in this paper allow to create a gaussian parametric family of 
stationary and periodic processes of arbitrary regularity. In fact, let us consider 
the following family of processes in ,3if: 

oo 

Xt = V ^(rfesin(2fc7r<) +yfc'cos(2fc7rt)). (6.1) 

k=l 

Theorem 5.2 states that the paths become more regular as p increases. This 
property is shown in Figure 1, which suggests how to smooth a process by 
changing p. 

Model (6.1) gives a family of gaussian processes whose trajectories are ar- 
bitrarily regular. In application, maximum likelihood estimates of a and p is 
a straightforward consequence of a FFT of the observed discretized process 
{xt}tg[o,i]- The property of these estimators are studied in the following sec- 
tion. 
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6.1. Maximum likelihood estimators of (6.1) 

Given {xtg, , . . . , Xt^) sampled from (6.1), we want to find the property of the 
maximum likelihood estimator {d,p) of the parameters {a,p). 

More precisely, with a equispaced or nonequispaced Fourier transform (see, 
e.g., [3, 4]), we first transform {xto,Xtj^, . . . ,Xt„) into {y[^\y2\---,yn^) and 
iUi J 2/2 1 ■ • ■ 7 2/n ) (real and imaginary part). As a consequence of Theorem 2.2 
applied to (6.1), there exist two sequences {Yk)k and {Y^)k of independent gaus- 
sian standard random variables such that 

,,(1) _ „y: ,,(1) _ ,,(1) _ _a^Y 

ill — 1 7 i/2 ~ 2? 2 7 • ■ • 7 yn — nP n- 

The log-hkelihood function then reads 

n 

inia,p) = -nlog(27r) - 2nlog(a) + 2p^ log(/c) 

k=l 

k=l 
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and hence, if Ok = {y'^'^Y + {vt^Y^ k = l,...,n and ■0 = Z]fc=i ^og{k), we get 
d£n 2n 



da a a- 

k=l 



^ = 2^' - ^ E ^OE{k)k^^o, = log(fc) (2 - ^) (6.2) 

^ k=l k=l 

As expected, when pq is a known parameter, 

fc=i 

while nothing is known about the distribution of p, for small n, and for the 
distribution of the couple {a,p). We have the following asymptotic results, whose 
proof may be found in Appendix E. 

Theorem 6.1. There exists an ML estimator {pn)n, zero of the equation (6.2), 
such that 

Pn > PO, , > N{0, 1). 



71— ^OO 



Moreover 



ao V" I f a„ — ao 

ELi j \Pn -Pa J \-l 



where Z is a standard gaussian variable. 

As a corollary of Theorem 6.1, the joint perfect correlation between dn and 
Pn is asymptotically predicted. In Figure 2 we show this fact by simulating the 
processes and the maximum likelihood estimates (p > 0.94 for n — AQ and 
different values of ao and po)- 



Appendix A: Proofs of results of Section 2 

Proof of the Theorem 2.2. By Mercer Theorem (see, e.g., [1]) we know that if 
(en)n is an orthonormal basis for the space spanned by the eigenfunctions corre- 
sponding to nonzero eigenvalues of the integral operator (2.1) then, uniformly, 
absolutely and in L^[0, 1] x [0, 1], 

oo 

C(s,t) = ^efc(t)efc(s)Afe, (A.l) 

where is the eigenvalue corresponding to e^. By hypothesis, since C{s,t) = 
C{\t - s\) = C{\t - s| ± 1) by Remark 2, we get 

/ (7(5) cos(2n,7rs)ds = a„, / C{s) sm{2mTs)ds ^ 0, (A.2) 
Jo Jo 
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0.1 0.2 0.3 0.4 



3 4 



0.1 0.2 (, 0.3 0.4 



3 4 

■I = ;{ , J, = 2 



0.1 0.2 ,, 0.3 0.4 



2 3-4 5 



Fig 2. Plot of 200 (a^p)-joint simulations (blue point) of data coming from (6.1) for different 
values of a and p (red stars). In these pictures, n = 40 (see section 6.1 for notations). 



and hence 



C{t) = ao + 2 ^ Qn cos(2n7rT). 



(A.3) 



It is simple to prove that the sequence (s„(t), c„(t))„ contains all the eigenfunc- 
tions of the operator (2.1). In fact, 



C[t, T)cn{T)dT = \/2 / C{s) cos{2mr{t + s))dt 

"'0 

~ /"^/^ ~ (A.4) 

= Cn(t) / cos{2mrs)C{s)ds — s,Jt) / sm{2nTTs)C{s)ds 

Jo J-l/2 



the same relation holding when c„(f) is replaced by s„(f). By (A.3), we get 

oo 

C(s, t) = C{s - i) = ao + ^ flfc cos(2fc7r(.s - t)) 

k=l 

oo <x> 

= ao + 2 Uk cos(2fc7rs) cos(2fc7r<) + 2 sin(2fc7rs) sin(2fc7rt) 

k=l k=l 
oo oo 

= ao + ^ akCk{s)ck{t) + ^ akSk{s)sk{t) 



k=l 



k=l 



where this equality holds uniformly, absolutely and in L^[0, 1] x [0, 1] by Mercer 
Theorem (cfr. (A.l)). 
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Now, since C{s,t) is a covariancc function, it is positively defined, and hence 
a,n > 0, Vn. Moreover, since (a„)„ G if we define c„ = ^/a^^ then (c„)„ £ 
From Theorem 2.1 we deduce the existence of two independent sequence of 
independent standard gaussian variables {Yn)m {Yn)n such that in mean square, 
uniformly in t 

oo 

xt = coY^ + Ck{YkSk{t) + Ylckit)). □ 
fc=i 

Proof of the Theorem 2.3. The sequence of gaussian processes y[^^ converges to 
a periodical {yt}tg [o.i] in mean square uniformly in t, since it is a Chauchy 
sequence: 

m 

sup £;[|y(")-2/^)p]=2^c| ^ 0. 

Hence, i?[yt] = 0, and Cov{yt,ys) = cl+J2T=i ^1 cos(2fc7r(s — t)) is a continuous 
function. Finally, {2/t}tG[o,i] is a gaussian process, since the two sequences {Yn)n 
and, {Y^)n are formed by independent gaussian variables. □ 

Proof of the Theorem 2.4. Necessity. Assume there exists a process {xt} G Jifz 
which generates {yt} G J^q. The covariance function C{s,t) of {xt} is given as 
in (2.2): 

OO OO 

C{s, t)^cl + Y, 4ck{s)ck{t) + clsk{s)sk{t). 

k=l k=l 

If we define a; = C(0, 0) = J2'o' 4^ Pi — 4/^^ and 

C(s t") °° °° 

D{s,t) = — "-^ =Po + Y PkCkis)ckit) + Y PkSkis)skit) , 

k=l k=l 

then, a; > and. by (2.3), we obtain 

xR{s,t) = D{s,t) - D{0,t)D{s,0) 



^ PO + ^PfcCfc(s)Cfc(t) + ^PfcSfc(s)Sfc(t) + 
k=l k=l 

oo oo 

Po + Yp>'^''^^^) {p'^ + Yp''^''^^^ 

k=l k=l 



(A.5) 



(A. 5) and (2.4) give 



xr^ = h if^=^>0 (A.6) 
|0 iffc^j 



'"Tj - ' kj 



Pk-pl a k = j >o 

-pkPo iik^ j 




(A.7) 
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Since ^20^ Pk = 1, if f = X^feLi ''fcfcj obtain by (A. 6) 

= 1 — Po- 

Assume f = 0, then po = 1, which is absurd since R{s, t) ^ 0. Hence f > 0, and 
we define 

x=^^, (A.8) 
Thesis foUows by combining (A.8) and (A. 7). 

Sufficiency. Given the matrices of the 2 ~ D Fourier series as in the theorem 
assumption, set a; > as in (A.8). Define 

Pk — ^kk -2 ' P^ ~ f ■ 

Then {pk)k>o is a non-negative sequence such that X^fePfc = 1- Define 

n 

Xt = y/xp^Y^ + ^ ^/xpI(YfeSfe(t) + Y[ck{t)). 
k=l 

By Theorem 2.2, we have 

oo oo 

C{s,t) = x(pq + ^pkCk{s)ck{t) + ^pkSk{s)sk{t)y 

k=l k=l 

It is straightforward to check that (A. 6) and (A. 7) hold. The fact that the 
solution is unique follows immediately from the necessary condition. □ 

Appendix B: Proofs of results of Section 3 

Proof of the Theorem 3.1. We recall that E{yt) =0, and VO < s, i < 1, Cov{yt,ys) 
min(s,t)(l — max(s,t)). A straightforward calculation yields, for any fc > 1, 

^fcfc = / / Cov{yt,ys)ck{s)ck{t)dsdt 
Jq Jq 

nl ^1 

Cov{yt,ys)sk{s)sk{t)ds dt = r^, 



1 



{2kn 



l2 



^0 



which contradicts the necessary condition for the existence of a process {xt} € 
Jif which generates {yt}tg [o.i] given in the Theorem 2.4. □ 

Proof of the Theorem 3.2. Assume there exists a process {it, t € [0, 2]} e J^(0, 2) 
which generates an extension of {yt] on [0,2]. Recall that the extension is on 
[0,2] and thus, by (2.2), the covariance function of C[s,f) is given by: 

oo oo 

C(s, t) = Cq + c\ cos(fc7rs) cos(fc7ri) + c\ sin(fc7rs) sin(A:7ri). 

k=l k=l 
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The covariogram function is C{S) ~ po + Y^'^Li Pk cos^kirS), where pi = cf > 0. 
Since yi = 0, by (2.3), we obtain 

^ ' ^ ' C(0) 

- , ^ (po + EZiPkCosik7r.s))(j:^i~)'^p,) 

Po + 2^i-rpkcos{kTTs)] - ^ =s — — -■ 

The integration on [0,2] with respect to cos(2m7rs), gives 

oo 

P2m(^P2fc+l) = 0, Vto > 0, 

fc=0 

and hence either all the odd terms {p2k+i)k or all the even terms {p2m)m are 
null, since the p^'s arc nonnegative. 

Therefore, the possible extensions of {yt,t G [0, 1]} are either 1-antiperiodic 
or 1-periodic (see Remark 3), which implies that the possible extensions of the 
covariance function of {yt, t g [0, 1]} to [0, 2]^ is given by 



R{s,t) = 



'Ris,t) ifO<s,t<l; 

{-yR{s,t-l) if < s < 1 and 1< t < 2; 

(-)'i?(s- if < t < 1 and 1 < s < 2; 
^i?(s ifl<s,t<2. 



where i = 1 relates to the antiperiodic extension and i = 2 to the periodic one. 
Theorem 2.4 states that if each of this two extensions may be generated by a 
(unique) process {x['\t e [0,2]} e J^z(0,2), i = 1,2. 

Now, we prove that it is not possible to have both the extensions at the same 
time. In fact, this fact would imply that both the functions 

oo oo 
k=l k=0 

generates R{s,t) = C^^Ht - s) - ^'^'^^^'^ by (2.3). 
Since C^i^i) = 0, we get 
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if se [0,1/2], 

(Er(-)''P2fe) (EfcloP2fc cos(2fc7rs)) 



'^P2k cos{2kTTs)] - 



fc=0 



P2k 

+g) 

C'(2)(0) 
(7(i)(i)C(i)(i + s) 



^ ' C(i)(0) 

OO 

C'W(s) = ^J'2fc+iCos((2fc + l)7rs) 



k=l 

• Again, since 2fc7r(i + s) = — 2fc7r(| — s) mod 27r, when s £ (1/2, 1], we 



obtain 



/ ^ \ V So (-) V2fe Efco ^^2^ cos(2fc7rs) 
Vp2fcCOs(2/c^s) - ^ 



C'(2)(l-s)- 



C(2)(0) 
C'(2)(l)c(2)(|-g) 
(7(2) (0) 



1 3 

C(i)(i)cW(|-.) 



-n2'2-^) (^-2) 



= C'W(l-s) 

C(i)(0) 

= C^^^s) = 5^P2fe+i cos((2fc + l)7rs) 

k=l 

By integrating (B.l) and (B.2) on [0,1] with respect to cos(2(fc + l)7rs), we 
obtain P2k+i ~ for any k, which implies C'^-* = 0. □ 

Proof of the Theorem 3.3. First, we prove that {xt,t £ [0,2]} given in (3.1) 
generates the antiperiodic extension of the brownian bridge to [0, 2]. In fact, it 
is sufficient to note that 



the function 



■i?(i,i + '5) = i-| ifO<5<i 
C«(<5) = <|i?(i,|-5) = i-| ifi<5<'l 
-C(i)((5-l) = i-^ ifl<5<2. 
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is a positive defined function on [0, 2]. since the weU-known Fourier series 
expansion of f{x) ~ \x\ on [—1, 1] gives 



CW(<5) = 4 5: 



cos(7r(2/c + 1)(5) 
(7r(2fc + l))2 ; 

• the function C*-^-* may be extended to a continuous 2-pcriodic function; 

• the process {xt,t € [0,2]} has covariogram function C'-^' by Theorem 2.2 
and Theorem 2.3 (extended on [0,2]); 

• by (2.3), R{s,t) = s(l - i) for < s < i < 1, i.e. {xt,t e [0,2]} generates 
the brownian bridge on [0, 1]. 

Then, since (3.1) is 1-antiperiodic, the process {yi^\t e [0,2]} e J^(0,2) 
generated by {xt,t e [0, 2]} is 



yt 




if < t < 1; 
if 1 < t < 2. 



To prove the uniqueness, by Lemma 3.2, we must prove that the periodic 
extension of the brownian bridge does not belong to J^o{0, 2). Assume the con- 
verse, there would be a 1-periodic periodic process which generates the brownian 
bridge, which contradicts Theorem 3.1. □ 



Appendix C: Proof of the Theorem 4.1 

The case xt = k is obvious. Let C{t, s) ^ C{t — s) be the covariogram function 
of {xt}te[o,i] (see (2.2) for its expansion). Since xt = k C'(O) = 0, we 

assume, without loss of generalities, that (7(0) = 1. 

A straightforward computation gives that, if {2/t}tg[o,i] G is generated by 
{a;t}tg[o,i] G , then {yt}(g[o.i] is a gaussian process with null expectation and 
continuous covariance function 

i?(t, s) = C{t -s)- ^^^^ = C{t -s)- Cit)Cis). (C.l) 
G (Oj 

Hence, given the covariogram function C{s,t) = C{t — s) of the generating 
process {a;t}te[o,i]j we need to study the spectrum of the operator (2.1), where 
C is replaced by R given in (C.l). 

As in (A. 3) and (2.2), we write C{t) ~ qq + 2 a„ cos(2n7ri) with 1 = 

00 + 2^^-1^ On since (7(0) = 1. Let f{t) an eigenfunction of (C.l); for expansion 
theorem (see [1]) we have in L^[0, 1], 

oo 

f{t) = f0 + Y.fnCn{t)+Ks,it). (C.2) 

n=l 
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where /o = /g^ /(T)dr, = Cn{T)J{T)dT and = /g^ Sn{T)f{T)dT. Let's look 
for the eigenvalue related to /: 

R{s, t)f{t)dt = f C{t- s)f{t)dt - C{s) f C{t)f{t)dt = ~af{s). (C.3) 
Jo Jo 

Substitutmg (C.2) into (C.3), and integrating with the results in (A. 2) and 
(A. 4), yields 

OO CXD 

ao/o + E«"(/n'="(^) + /X(s))-(5(s)(ao/o + V2^a„/;j) =a/(5). (C.4) 

n—l n=l 

C.l. s„(s) eigenf unctions 

For any a„ ^ 0, it is straightforward to see that /(s) = s„(s) is an eigenfunction, 
by a direct substitution in (C.4), and that d = an- Moreover, we are going to 
state more: the only eigenfunctions which contains some 7^ are indeed s„(s) 
(when a„ ^ 0). 

Assume that 3k: 7^ and, by contradiction, f{t) ^ Sk{t). 
By multiplying both members of (C.4) by Sfe(s) and integrating, we obtain 
Ofc/I = a/|, i.e., Gk = d. Since ak 7^ 0, then siJt) is an eigenfunction. This 
eigenfunction is orthogonal to /(s) by Mercer Theorem, and hence 

0= f\k{s)fis)ds ^ f^. 
Jo 

Summing up, for any 7^ 0, s„(t) is an eigenfunction associated to a = a„, 
and the other eigenfunctions do not contain the terms in (s„(i))„ (they are even 
function). 

C.2. The other eigenfunctions of (C.4). 

To conclude the proof, we should find another sequence of eigenfunctions with 
eigenvalues (a„)„ x (a„)„. We will first obtain a simple result on the coefficients 
of the eigenfunctions. Then we will introduce the multiplicity of the eigenvectors 
(a„)„ in order to conclude the proof accordingly. 

The other eigenfunction takes the form f{t) = fo + J2T=i fk^kit)- By multi- 
plying both members of (C.4) by c„(s) and integrating, we obtain 

Uo/o - ao(ao/o + %/2X;^i flfc/fe) = 5/0, n = 0; 

As an immediate consequence, (a„ = 0) => [f^ = 0). 
Lemma C.l. {ffXen e and fo + %/2 E^^i /« = 0. 
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Proof. Recall that a„ > 0, and that ao + 2 X^i^i = C'(O) — 1. For n > 0, by 
(C.5), we have 



\rn\< 



and since {ak\f^\)k G (-^ (as a product of two £^ sequences), and (a„)„ € we 
obtain the first part of the thesis. By (C.5) and oq + 2 — C'(O) ~ 1, we 

get 

/o + \/2^ = ~ ao(Qo/o + ^Y.t=i "-kfk) 

n— 1 



a 



ao 



a 



ao 



2X]a„) =0.n 



Definition C.l (Multiplicity and support). Given (a„)„, we define the support 
Sa of a: 

Sa = {k: ak = a}. 
The multiplicity rria of a number a > is the cardinality of Sa- 

ma = #{fc: afc = a}. 

It is clear that nia < oo because (a,i)„ £ i^. 

Lemma C.2. Ifrua = fc > 0, i/ie??. i/iere are exactly fc — 1 orthogonal eigenfunc- 
tions of R related to a. Moreover for anyone of these fc — 1 eigenf unctions, 

n(^S~a =^ = 0. 

Proof. Let a > be such that ma > 1. 

It is simple to prove that there always exist ma — 1 orthogonal eigenfunctions 
related to a with = if a„ ^ 5a. We have two possibilities: 

• G 5a or, equivalently, ap — a. In this case, (C.5) is equivalent to the 
following system 



\a(/o + ^/2E„e5.\{o}/«)^0- 
^ 5a. In this case, (C.5) is equivalent to the following system 



=0, n ^ 5a 
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In both cases, there exist a fc — l-dimensional orthogonal basis for the solution 
system. 

We now need to prove that there are not other eigenfunctions related to a. 
Assume that 0. We recall that this fact implies Ofj 7^ 0. If n = 0, from 

(C.5) we have that 

The second equation shows that ao/o + V^X^^Li Qfc/fc = Oj since a„ = 5, and 
hence ao = a, which means that n G Sa- Analogously, if n 7^ 0, from (C.5) we 
can prove that n G S'a, that completes the proof. □ 

Let (a(„))„ be the decreasing reordering of the sequence (a„)„, positive and 
without repetition: a(i) > a(2) > • • ■ > a(„) > • • • and Va„ > 0, exists k such 
that a„ = a(fe). To conclude the proof, we must find a sequence of eigenvalues 
(a„)„ such that (a„)„ x (a(„))„, and a„ ^ a{k), for any n and k. 

Lemma C.3. For each n £ N, there exists a unique eigenvalue a„ such that 
a(„) > a„ > a(„_|_i). Moreover, rUa,^ = 1. 

Proof. We have already observed that ao/o + V^X^fcLi '^fc/fc ~ implies, for 
any n, a„ = a or /^ = 0. Hence, without loss of generalities, we assume ao/o + 
V^X]fc°=i '^'s/fc = c 7^ and we continue the proof. From (C.5), we obtain 

„ Qq „c V2a„ 

/o = c r, /„ = c r. (C.6) 

ao — a a„ — a 

These relations with, again, ao/o + "v/2 '^n/n = c, imply 



^0 



2V^^ = 1. (C.7) 



ao — a ^ — ; a. 

n—l 

We are going to show that there exists a unique solution a„ of (C.7) such that 
a(„) > a„ > a(„_|_i). These are the wanted eigenvalues, whose corresponding 
eigenfunctions' expansion is given in (C.6). 
Let us consider the series 

2 °o 2 



ao — a; ^ a„ 

n—l 



and the derivative series 



2 C30 2 

5'(a;) = ^L+2^ 



(ao - a;)2 (a„ - a;)^ 

then they converge absolutely in each compact not containing (a„)„. We have 
that 

dom(5) = dom(s) = U„(a(„^i), a(„)), S'{x) = s{x),\fx G dom(S'). 
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Moreover for each n, 

lim S{x) = —oo, lim iS'(a::) = +00, 5'(a;) > 0,Va; G (a(„+i),a(„)). 



Hence, there exists a unique a„ g (a(n+i)! '^(n)) such that S'(a„) = 1, i.e. for 
which (C.7) holds. The unique corresponding cigenfunction is given by (C.6), 
that imphes also ma„ = 1: 

00 

n—l 

To complete the proof, we show that there are not eigenvalues greater then 
0(1) = maxra a„ or smaller than any a„ > 0. 

In fact, if we assume that there exists an eigenvalue a > maxa„, then (C.6) 
shows that the sequence (/^)fc is made of either nonnegative or nonpositive 
numbers, that together with Lemma C.l implies fj: = 0, for any /. 

In the same way it can be shown that there arc no eigenvalues smaller than 
any a„ > 0. □ 



Appendix D: Proofs of results of Section 5 

We simply deduce the results basing on the fact that if y « N{0,a'^), then 
E{\Y\P)^<jP '^^^\ (see, e.g., [11]). 
Proof of the Theorem 5.2. . Observe that 

E{\xt+h ~ a;t|^) = E{x^ + x^^f^ - 2xt+hXt) = 

^ R{t + h,t + h) + R{t, t) - 2R{t + /i, t) 
but there exists an M such that 

\R{s + Si,t + S2)- R{s,t)\ < M\\{Si,S2)r 

and so there exists a D such that 

E{\xt+h - xt\^) < D\h\". 

Then the thesis follows. □ 

Proof of the Theorem 5.3. The first part of the theorem is a simple calculation. 
The second holds because, using theorem 5.1 we have 

E{\xt+h - xt\^) = E{E{\xt+h - Xt\^\xo)) = 

= E{E{{xt+h - x^) - {xt - xo))^|xo)) = 
^ R{t + h,t + h) + R{t, t) - 2R{t + h, t) < D\h\". 

□ 
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Proof of the Theorem 5. 5. It is clear that 

oo oo 

d^C{S) = 29^ d cos(2fc7r(<5)) = -2 ^ {2T:fk^cl cos(2fc7r(5)) 

k=l k=l 

and that d'^C e C°^"([0, 1]) , for some < a < 1. Moreover we have that 
uniformly in t and in mean square 

oo 

xt = coYo' + Ck{YkSk{t) + Ylck{t)). 

k=l 

and, from Theorem 2.2, there also exist a stochastic process in such that 
uniformly in t and in mean square 

oo 

Xt = 2TrY kck{YkCk{t) - Yj^Sk{t)), 

k=l 

which has covariogram function belonging to C°'"([0, 1]) given by 

oo 

d{S) = 2 ^ i2TT)^k^4 cos(2/c7r((5)). 
fe=i 

If we define 

n 

:= coFo' + E ^^i^kSkit) + Y^Ckit)) 

n 

:= 27Tj2kckiYkCkit) - Y^Skit)), 

k=l 

than y^"-* — ?/q"^ + yr^^dr, a.s. for any n, while for each fixed in mean square 
we have /J yi"''rfT — Xrdr. Since 



J^irdrr)<^E[{xt-yi''^r) 



0, 



it follows that a.s. xt — xq + Xrdr. By Theorem 5.2 we know that almost all 
trajectory path of xt belongs to C"''^([0, 1]), with /3 < ^, and thesis follows. □ 

Appendix E: Proofs of results of Section 6 

Proof of Theorem 6.1. Assume po be the true parameter, we may define a se- 
quence of i.i.d. random variables {Zk)k in the following way: 

Zk-^^^xl-oMh)- (E.i) 
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Equation (6.2), as a function of {p,po) and {Zk)k, becomes 

^^^log(fc)(2-fc^(--)Z,). 
^ fe=i 

With the notation of [5, pagg. 155-161], we have 

n 

in(p) = ^iog^(fc)£;((2 - e(p~p-^Zkf\z,, 

1 

n 

= J2 log'(fc)2(l + (1 - 2fc2(p-Po))2)^ 
1 

J„(p) = - Vlog'(fc)fc2fofc = -2 Vlog2(fc)fc2(P-Po)Zfc 

^' k=l k=l 

and, in particular, 

n 

/„(po)=4^1og2(fc), (E.2) 

1 

n 

J„(po) = -2 5]log2(A:)Zfc. (E.3) 
1 

The thesis is a consequence of [5, pagg. 155-161], where the Assumption 1 
and Assumption 2 on page 160 guarantee the existence of a ML estimator (p„)„ 
such that 

a.s Pn ~ PO L n 
Pn > PO, . ^ ^ > N{0,1). 



Check of [5, Assumption 1, pagg. 160]. The fact that In(j>o) oo is 

n— ^oo 

a consequence of (E.2). As /„(po) = E{La{po)), then In{po)/ E{I„{po)) 1 
uniformly on compacts. By (E.2) and (E.3), we have 

J„(po) _ -2Eilog'(fc)Zfc 



IniPo) 4 El log' (fc) ' 

and hence, by (E.l), we have 

'Jn{Po)\_^ fJn{Po)\_ Ellog^^s) 



E 



V/«(poW WnPoV 



.(PO)^ ' yin{po)J (Ell0g'(fc))2 

Since, for n > 4, 

log'(") 1 18 
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then , f T^rf-^sT-^)" < oo, and hence Var(i4^) — !• by Kroncckcr's 

A^n=l V log^(m) / ' \ I„(Po) ' •' 

Lemma, which ensures that IniPo) / E{In{po)) ^ ^1 in probabihty uniformly 
on compacts. 

Check of [5, Assumption 2, pagg. 160]. Since, for any p, Ep{In{p)) does 
not change, then Assumption 2.i) is automatically satisfied. 
Now, if |p„ - Pol <5/ ^JlniPo), we get 

n s 
\Jn{Pn) - Jn{Po)\ < 2 ^ V (fc) (fc V^? <'"' - l)Zfe (E.5) 

fe=l 

n s s 

\In{Pn) - In{po)\ < ^ log^ (fc)8fc'^'^ (fc'^^^ - 1) 



k=l 



Note that, since k < n. wc have 



log(n) 



< exp(2,5) 



and hence, for sufficient large n and k < since 



k y^^^ - 1 < Cn2- 



\/lniPo) 



log(fc), 



we obtain 



- 4E"iog2(fc) \tt^EiV(" 



(E.6) 



^(po) 



By (E.4), then ( ^"°fog"(L) ) ^ ^ ^^'^ hence, by Kronecker's Lemma, 

we get Assumption 2.ii), namely 

IniPn) - In{Po) 



In{pa) 

The last Assumption 2.iii) requires that 

JniPn) - Jnipo) 



In{Po) 

To check this, we first note that 



^ 0, 



a.s. 



0, 



as a consequence of Kronecker's Lemma, (E.6) and (E.4). Then 



E 



Jn{Pn) ~ J7i{Pq)\ ^ E{\Jn{pn) ^ JniPo)\) 



r Jn[Pn) 



iPo) 



In{po) 



0, 



imsart-generic ver. 2011/11/15 file: AR_arxiv.tex date: November 1, 2012 



G. Aletti and M. Rujfini/ Gaussian periodic processes 



25 



and hence, a sufficient condition for '^"^^/^(p^)'^'^"^ — )• to hold, is that 



Var 



Jn{Pn) - JniPo) 



IniPo) 

By (E.5), since Var{Xk) = 4, we obtain 



(E.7) 



Var{JM - J„(po)) < 8 ^log^(fc)(fcVsr - l) 
Again, by (E.6), wc obtain 



fc=i 



Vc 



log'(fc) 



As above, by (E.4) and Kronecker's Lemma, wc obtain (E.7). 



We sketch the second part of the proof, with the notation of [6, pag.191]. If 
wc define 

«i^n«,.)4E ^--2UiE ^-^^.-2 



and 



a — ' \ a" 

k=l 



fe=l 



Gi'Ha,p) = Elog(fc) 2 - —Ok) = 5^1og(fc) 2 



k=l 



fc=l 


1 



it is simple to state that 



H„^(ao,po) • G„(ao,_po) ^ ( \ I ^- 

n— >-oo \ — i , 



(E.; 



In fact, since {Zk)k is a i.i.d. sequence of r.v. with mean 2 and variance 4 (see 
(E.l)), we get. 



- n ,1 

and hence 



k=l 



A;=l 



^ / ^0 s Gn\aQ,PQ) 

Corr[ —=G\,>{aQ,pQ), , 



-ELiiog(fc) 
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Now, since 
G(ao,po) = 



/ _4n 4E^^ilog(fc) \ 

V^^%^ -4ELiiog^(fc); 

then, by (E.8) (sec [6, pag.191]), we get 

H^^(ao,Po) ■ (-G(ao,Po)) • ( ( \ ) ^, 

\Pn — PnJ n->cx) \— i/ 

which is the thesis, once the conditions of uniformly boundedness are checked 
as for the previous case. □ 
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